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ABSTRACT 

Purpose - This study was aimed at establishing, through the 
validation of the Teaching and Learning Guiding Principles 
Instrument (TLGPI), the validity and reliability of the underlying 
factor structure of the Teaching and Learning Guiding Principles 
(TLGP) generated by a previous study. 

Method - A survey method was used to collect data through the 
67-item TLGPI. The TLGPI was hypothesised to measure the six 
constructs of the TLGP. The TLGPI was administered online to all 
academicians from 20 public universities in Malaysia. In total, 284 
responses were received from a population of 31,608 academicians. 
The collected data were subjected to a Confirmatory Factor Analysis 
to test for construct reliability, model fit, and convergent validity 
of each contruct’s measurement model. The CFA was also used 
to test the model fit and the discriminant validity of the pooled 
measurement model. 

Findings - The CFA supported a finalised measurement model of 
six constructs for the TLGP. The TLGP was found to have reliable 
and valid constructs that represented the aspects of teaching and 
learning that are important in Malaysian higher learning institutions. 
Significance - This pioneer study is vital in the Malaysian higher 
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education context since the development of teaching and student 
learning can benefit from a set of empirically validated teaching and 
learning principles. The TLGP are statements on the scholarship of 
teaching and learning and can be a reference guide to good practice 
that can help set the pathway to a high-quality learning environment 
for students in the Malaysian higher learning institutions and the 
wider Asian context. 

Keywords: Teaching and learning, guiding principles, higher 
education, CFA. 


INTRODUCTION 

The development of teaching and student learning in higher education 
is a key issue for universities worldwide (Olsson & Roxa, 2012). 
Now more than ever, many nations around the world are actively 
making a serious effort to reform and transform their education 
systems. The latest effort by the Malaysian Ministry of Education is 
documented in the Malaysia Education Development Plan (Higher 
Education) 2015 - 2025, launched in April 2015. Ten key issues are 
emphasised in the plan, and the first issue, which is closely related 
to our overall research, is producing graduates who are holistic, have 
entrepreneur characteristics and are balanced. 

Therefore, it is imperative that all higher education institutions 
in Malaysia strive to improve their graduates’ quality across 
intellectual, spiritual, emotional, and physical dimensions to enable 
them to thrive in today’s complex global economy and contribute to 
the betterment of society. One of the strategies is to institutionalise 
a holistic and integrated curriculum that includes the necessary 
quality design, delivery and assessment aspects. The central player 
in ensuring that these aspirations become a reality is the educator, 
since quality educators are the definitive determinants of student 
achievement. Our related study (Nurulhuda & Azwani, 2014) has 
shown that more than 80% of the educators in the sample maintained 
the traditional mode of delivery, the i.e., by using standard lecturing 
where they explained the materials while students passively listened 
and perhaps took notes. A study by Siew et al. (2015) showed 
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that students in one of the Malaysian universities relied on their 
educators for information and were not inclined to explore on their 
own. A more learner-centred approach to teaching and learning 
where students have to be actively engaged during a lesson would 
be challenging to implement, given this prevalent scenario. 

The development of teaching and student learning can benefit from 
a set of teaching and learning principles. Teaching and learning 
principles are statements on the scholarship of teaching and learning 
and a reference guide to good practice. These principles represent 
the shared view within an institution of the processes and conditions 
that contribute to a high-quality teaching and learning process 
(University of Melbourne, 2007). Elements of the principles should 
be embedded in the fundamental philosophy adopted by a particular 
institution and reflect the institutional commitment in providing 
a high-quality teaching and learning ecosystem. Together, these 
principles should reflect the conditions under which student learning 
can thrive and thus, have a direct bearing on the quality of student 
intellectual development. 

For our research, the TLGP will be used to develop a framework 
for teaching and learning. We hope that the TLGP can be used 
by educators from different backgrounds and disciplines to work 
together to plan, develop, and provide coherent interdisciplinary 
learning experiences for students. Thus, in general, teaching 
and learning principles can be a guide to the maintenance and 
enhancement of teaching and learning standards. The suggestions 
of good practice offered by the guidelines provide benchmarks to 
which the institution is committed within the parameters of available 
institutional resources. The ultimate objective of the institution’s 
teaching and learning programs should be to prepare graduates 
with distinctive attributes that enable them to contribute to the ever- 
changing global context in a meaningful and positive way, in line 
with the aspirations stated in the Malaysia education blueprint. 


REVIEW OF LITERATURE 

There are very few empirical studies that develop teaching and 
learning principles. We have not found a single study that develops 
and generates teaching and learning principles such as the one we 
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are developing. One empirical study that is somewhat related, but 
focuses only on the teaching and learning of web-based distance 
education was by Kanuka (2002). The outcome was the development 
of a model with nine principles that facilitate higher levels of learning 
in Web-based distance education. All nine principles resonated 
well with our principles. For example, principle 1 (learning that 
involved complex abstracted phenomena), principle 2 (learning that 
included diverse and/or multiple perspectives), principle 3 (learning 
that included phenomena that had personal relevance), principle 

4 (learning that included diverse ways of knowing), principle 5 
(learning that included an assessment process that was personally 
meaningful), principle 6 (learning that required learners to assume 
greater responsibility), principle 7 (learning that required learners 
to build meaning), principle 8 (learning that required learners to 
understand their worldview) and principle 9 (learning that required 
learners to provide evidence of new understanding) were all aligned 
with our principle 1 (teaching and learning that fostered an atmosphere 
of intellectual excitement), principle 4 (constructive alignment 
between an evolving knowledge base, student learning outcomes, 
learning experiences, actual practice, and assessment), principle 

5 (international and culturally diverse learning environment) and 
principle 6 (climate of inquiry and critical reflection). In validating 
these principles, the study used expert validation through a two-stage 
focus group examination of the generated provisional principles. 
For our research, after conducting the expert validation process, we 
validated our principles further using the rigour of CFA statistical 
analysis. 

Korthagen, Loughran and Rusell (2006) sought to develop principles 
for teacher education programs and practices unlike our narrower 
concept of teaching and learning as the delivery of the curriculum. In 
generating their principles, the researchers analysed three education 
programmes from different continents and used a meta-analysis of 
different studies on the programmes. Analyses done were primarily 
qualitative in nature, for example through the use of concepts such 
as naturalistic generalisability, catalytic validity, dialogic validity 
and pattern matching. The outcome was seven principles of learning 
about teaching. Since the seven principles were focused on change 
in teacher education, they were more encompassing in the way they 
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were stated. For example, principle 1 stated that learning about 
teaching involved continuously conflicting and competing demands. 
As teacher education could not adequately prepare teachers for their 
entire careers, teacher education programmes inevitably needed to 
respond to a range of conflicting and competing demands (Korthagen 
et ah, 2006). However, our principles were more focused on the 
good practices within the classroom itself. 

An institution or center usually developed teaching and learning 
principles based on inputs from a group of scholars or experts within 
and outside the institution. Thus, the methodology of generating 
these principles could not be gleaned from the literature. Teaching 
and learning principles developed by these institutions usually 
referred to the overall teaching and learning environment, and were 
not limited to the delivery of the curriculum. However, our research 
was part of a bigger research project aimed at developing a model 
of teacher education by focusing on five components of teacher 
education, namely curriculum, teaching and learning, assessment, 
teacher leadership, and clinical experience and teacher induction. 
Guiding principles for each of the components will help inform the 
development of a teacher education model. 

Several examples of teaching and learning principles included the 
ones developed by the Eberly Centre and Queensland State Schools. 
The principle of effective teaching developed by the Eberly Centre 
(Carnegie Mellon-Eberly Center, 2008) comprised seven themes, 
namely analysing student needs, constructively aligning learning 
objectives, assessments and instructional activities, articulating 
explicit expectations, prioritising certain knowledge and skills, 
recognising and overcoming their expert blind spot, adopting 
appropriate teaching roles, and progressively refining courses based 
on reflection and feedback. 

Queensland State Schools formulated five guiding principles for 
the development and implementation of quality learning programs 
through promoting effective learning and teaching (Education 
Queensland, 2012). In essence, the principles stressed the need to 
understand the learner and the learning process, provide a supportive 
and challenging environment, establish worthwhile learning 
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partnerships, and shape and respond to a variety of social and cultural 
contexts. These principles were based on the assumptions, among 
others, that the principle of effective learning and teaching provided 
the basis for the ongoing improvement of learning and teaching 
practices. It is clear that both the Eberly Centre and Queensland 
State Schools have adopted principles that encompassed not only 
the delivery of curriculum, but also the whole teaching and learning 
ecosystem. 

Another illustrative example is from the Teaching and Learning 
Research Programme (TLRP) in the UK that has developed evidence- 
informed pedagogic principles, the product of an iterative process of 
consultation and debate between researchers, practitioners, policy¬ 
makers and the TLRP Directors’ Team (Teaching and Learning 
Research Programme, 2007). They generated 10 principles that 
included themes such as equipping learners for life, engaging with 
valued forms of knowledge, recognising the importance of prior 
knowledge and experience and scaffolding learning, promoting 
active engagement and the need for constructive alignment between 
assessment and learning, fostering both individual and social 
processes and outcomes, and recognising the significance of informal 
learning. They also demanded a consistent policy framework with 
support for learning as the primary focus. However, there was no 
accessible documentation on the processes in developing these 
principles. 


BACKGROUND OF THE RESEARCH 

The purpose of this article is to present the processes and analyses 
involved in further validating the Teaching and Learning Guiding 
Principles (TLGP) in the context of higher learning institutions in 
Malaysia by Adnan, Masuwai, Tajudin, & Rahman (2015). The 
previous stage of the research resulted in six key themes, later 
labeled as constructs, related to principles of teaching and learning. 
They were: (a) nurture good values, (b) intellectual excitement, (c) 
quality learning spaces, technology and resources, (d) constructive 
alignment, (e) international and cultural diversity, and (f) climate of 
inquiry and critical reflection. The process involved several steps 
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of document analysis, content analysis and gap analysis. Data were 
gathered from three sources, namely the literature on teaching and 
learning theories, policies and practices, teaching and learning 
guiding principles from selected institutions, and 10 key informants. 

Each of the constructs was subsequently expanded into a sentence 
or a phrase to form a statement of principle, as shown in Table 1. 
Constructs were defined as the essential elements that constituted 
each principle. Corresponding to each of the six guiding principles, 
10, 16, 12, 7, 10, and 12 items were generated respectively, giving 
a total of 67 items. The items were put together in the form of a 
questionnaire and named the Teaching and Learning Guiding 
Principles Instrument (TLGPI). We used a 5-point Likert Scale; 
from 1: ‘Not important at all’ to 5: ‘Extremely important’, to assess 
the importance of each of the items in the context of teaching and 
learning in higher education. The responses were assigned values of 
one to five, respectively. 


Table 1 

Six Teaching and Learning Guiding Principles (TLGP) 


No. Teaching and Learning Guiding Principles 

1 Nurture good values, attitudes and behaviours 

2 Foster an atmosphere of intellectual excitement in students 

3 Quality learning spaces, resources and technologies 

4 Constructive alignment between an evolving knowledge base, student 
learning outcomes, learning experiences, actual practice, and assessment 

5 International and culturally diverse learning environment 

6 Climate of inquiry and critical reflection 


In this study, further validation of the constructs underlying the 
TLGP was conducted using Confirmatory Lactor Analysis (CPA) 
through a validation of the TLGPI. More specifically, our research 
objectives were: 

a. to establish, using CPA, the construct reliability, model fit and 
convergent validity of the constructs underlying the TLGP; 

b. to establish, using CPA, the model fit and discriminant validity 
of the pooled measurement model of the TLGP. 
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METHODOLOGY 


Sample 

We administered the TLGPI online through a link in emails that 
were sent to all 20 public institutions of higher learning in Malaysia. 
Our request to forward the link to all academicians in the public 
universities was made with the assistance of each institution’s 
public relations officer. Altogether a total of 284 responses were 
received from a population of 31,608 academicians, which gives 
a response rate of 0.90%. The population size was estimated from 
the number of academicians as posted on the official website of 
the Ministry of Higher Education for 2014. Some researchers (e.g. 
Nevitt & Hancock, 2001) recommended a minimum sample size of 
100, while others recommended at least 200 for reasons of accuracy 
(Kenny, 2012; Kline, 2011). Accordingly, a sample of 284 for this 
study was considered adequate. 

Instrument 

As stated earlier, the instrument used to collect further data was the 
TLGPI, the same instrument used in the previous stage of the research 
(Adnan et ah, 2015). In validating the factor structure underlying 
the TLGP, we were in effect validating the factor structure of the 
TLGPI. 

Data Analysis 

Data analysis involved an examination of construct reliability and 
included internal reliability and composite reliability. In addition, 
in order to establish the underlying structure of the measurement 
used, the data were subjected to a confirmatory factor analysis 
using AMOS 22.0. The analysis served to validate that the model 
developed by the researchers fit the data collected. The comparison 
between the previous study about the TLGP and this study is as 
shown in Table 2. 
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Table 2 

Comparision of Previous and Present Study of Teaching and 
Learning Guiding Principles (TLGP) 


Previous study 
(Adnan et al., 
2015) 

The EFA study 
informed the 
mean, standard 
deviation 
and internal 
consistency of the 
constructs. 

The overall value 
of Cronbach’s 
alpha was 0.977. 

EFA 

demonstrated six 
main factors in 
generating TLGP. 

All six factors 
contributed a 
total of 62.56 
percent of the 
overall variance 
shift. 


This study 


Using CFA, 
the construct 
reliability, model 
fit and convergent 
validity of 
the constructs 
underlying TLGP 
were established. 

Using CFA, the 
model fit and 
discriminant 
validity of 
the pooled 
measurement 
model of TLGP 
were established. 


Reason 


CFA was employed to test whether the 
measures of the construct were consistent 
with the researchers’ understanding of the 
nature of the constructs (Awang, 2014b). 

CFA was used to confirm that the 
indicators sort themselves into factors 
corresponding to how the researcher had 
linked the indicators to the latent variables. 

CFA was considered the best known 
statistical procedure for testing a 
hypothesised factor structure (Schumacker 
& Lomax, 1996; Byrne, 2001; Wang & 
Ahmed, 2004). 

EFA was used as an exploratory first step 
in the development of a measure, and 
then CFA was used to confirm the factor 
structure identified in EFA (Harrington. 
2009). 

EFA was more data driven while CFA was 
more theory-driven (Harrington. 2009). 


RESULTS 


Evidence of Unidimensionality 

Unidimensionality refers to how well the various items or indicators 
measure the same latent construct. Unidimensionality assessment 
should be made before the assessment of reliability and validity 
(Awang, 2014a). The assessment of unidimensionality can be 
determined by an item’s factor loading. Hair et al. (2006) suggested 
that an item was significant if its factor loading was greater than 0.50. 
Five items were deleted because they produced low factor loadings. 
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The items were IE8 (0.44), QL26 (0.44), CI55 (0.46), NV65 (0.44) 
and NV66 (0.41). The 62 items retained had factor loadings that 
ranged from 0.57 to 0.86 significant at p < 0.01. 

Evidence of Construct Reliability 

The assessment of reliability for a measurement model can be 
determined by calculating the internal reliability (a > 0.7) and 
composite reliability (CR > 0.6) values. Based on the reliability 
analysis, the internal reliability showed an overall Cronbach alpha 
value of 0.976 which exceeded the acceptable value of 0.70 (Hair et 
al., 2010). Furthermore, the Cronbach alpha value for each construct 
ranged from 0.877 to 0.930. For composite reliability, the overall 
value was 0.868 and the individual values ranged from 0.841 to 
0.911, well within the range suggested by Robinson et al. (1991) and 
DeVellis, Fewis, and Sterba (2003). The high reliability for each of 
the six constructs seemed to indicate that the items amalgamated 
well within each construct. Table 3 shows the details of the reliability 
values for all of the constructs. 


Table 3 

Reliability Values of Constructs of the Teaching and Learning 
Principles 


Construct 

no. 

Construct 

No. of 
items 

Internal 
reliability 
(a > 0.7) 

Composite 
reliability 
(CR > 0.6) 

i 

Nurture Good Values (NV) 

10 

0.877 

0.860 

2 

Intellectual Excitement (IE) 

16 

0.913 

0.868 

3 

Quality learning spaces (QL) 

12 

0.916 

0.846 

4 

Constructive Alignment (CA) 

7 

0.903 

0.884 

5 

International and Cultural 
Diversity (IC) 

10 

0.911 

0.841 

6 

Climate of Inquiry (Cl) 

12 

0.930 

0.911 
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Evidence of Model Fit for Individual Constructs 

Model fit for this stage of the analysis referred to how well our 
hypothesised model (in this case, the model of the factor structure 
for each construct) accounted for the correlations between variables 
in the dataset. A good fit showed that the model was plausible. To 
test for model fit, we assessed for fit indices. Among the available 
fit indices were relative chi-square (CMIN/DF), Tucker-Lewis 
Index (TLI), Comparative Fit Index (CFI), Incremental Fit Index 
(IFI), Normed Fit Index (NFI), and Root Mean Square of Error 
Approximation (RMSEA). For a sample size of more than 250, 
but less than 1000, and with the number of indicators of more than 
30, the criteria of the fit indices suggested are as summarised in 
Table 4. 

Table 4 

The Criteria for Fit Indices 


No 

Type 

Fit Index 

Recommended 
value of 
acceptance 

Author/Literature 

1 

Absolute fit 

RMSEA 

<0.08 

Byrne (2010); Hair et al. 


measures 



(2010 



GFI 

>0.09 

Schumacker & Lomax 





(2010) 

2 

Incremental fit 

CFI 

>0.09 

Bentler (1990) 


measures 

NFI 

>0.09 

Bentler & Bonett (1980) 



TLI 

>0.09 

Klem (2000) 




0.05 to 0.1 

Awang (2014b) 



IFI 

>0.09 

McDonald & Ho (2002) 

3 

Parsimony fit 

Chisq/df 

<5.0 

Bentler (1990) 


measures 





Flair et al. (2010) and Flolmes-Smith (2006) recommended using 
at least one fit index from each category of the model fit. Flair et 
al. (2010) also suggested three to four fit indices for establishing 
model fit. For this study, we chose the RMSEA for the absolute fit 
category; the CFI, IFI, NFI for the incremental fit category; and the 
CMIN/df for the parsimonious fit category as these indices achieved 
the recommended values for all of the constructs. Table 5 shows the 
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assessment of fitness for the model structure of each construct. Based 
on the suggestion by Hair et al. (2010), all constructs achieved the 
recommended value for at least three of the fit indices, suggesting 
that the model fits the data. Model fit was obtained after several 
items were deleted while others correlated. 

Table 5 

Assessment of fit indices for the model structure of each construct 


Fit index 



Construct 



Recommended 

value for a 
good fit 

Comment 

NV 

IE 

QL 

IC 

CA 

Cl 

CMIN/ 

2.786 

2.871 

1.555 

2.354 

1.042 

3.147 

<5.0 

Achieved 

DF 







Bender (1990) 

for all 

CFI 

0.975 

0.942 

0.994 

0.978 

1.000 

0.945 

>0.90 

Achieved 








Bender (1990) 

for all 

IFI 

0.976 

0.943 

0.994 

0.978 

1.000 

0.946 

>0.90 

Achieved 








McDonald & 

for all 








Ho (2002) 


NFI 

0.963 

0.915 

0.984 

0.963 

0.994 

0.923 

>0.90 

Achieved 








Bender & 

for all 








Bonnett (1990) 


RMSEA 

0.079 

0.076 

0.044 

0.069 

0.012 

0.087 

<0.08 

Achieved 








Byrne (2001) 

for all 

Deleted 

NV62 

IE2 

QL22 

IC42 

CA35 




Items 


IE3 

QL23 

IC43 

CA30 






IE4 

QL24 








IE5 

QL25 









QL27 






Correlat- 

NV58 

IE10 

QL18 

IC40 

CA31 

CI53 



ed Items 

and 

and 

and 

and 

and 

and 




NV59 

IEl 1 

QL19 

IC41 

CA34 

CA35 




NV60 

IE10 

QL17 

IC44 

CA30 





and 

and 

and 

and 

and 





NV63 

IE13 

QL20 

IC45 

CA35 






IEl 









and 









IE6 







48 

7 

11 

6 

8 

5 

11 



Final 









Items 
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Evidence of Convergent Validity 

According to Kline (2005), convergent validity refers to a set of 
indicators that is presumed to measure a construct. Brown (2006), 
however, defined convergent validity as the internal consistency 
of a set of items or indicators. These definitions are in line with 
the concept of unidimensionality. It represents the strength of 
relationships between items that are predicted to represent a single 
latent construct. To test for convergent validity, we determined the 
value of the factor loadings and average variance extracted (AVE). 
The values of factor loadings were reported earlier in the subsection 
on evidence for unidimensionality. The AVE is a more conservative 
test of convergent validity (Malhotra & Dash, 2011). It measures 
the amount of variance captured by the construct in relation to the 
amount of variance attributable to measurement error. Convergent 
validity is judged to be adequate when average variance extracted 
equals or exceeds 0.50 (i.e., when the variance captured by the 
construct exceeds the variance due to measurement error). All of the 
constructs had an AVE of above 0.5 as shown in Table 5. 

Table 5 

Convergent Validity tests results 


No. of 
Construct 

Construct 

Average Variance 
Extracted (AVE) (>0.5) 

1 

Nurture Good Values (NV) 

0.705 

2 

Intellectual Excitement (IE) 

0.663 

3 

Quality Learning (QL) 

0.679 

4 

Constructive Alignment (CA) 

0.770 

5 

International and Cultural Diversity (IC) 

0.687 

6 

Climate of Inquiry (Cl) 

0.710 


Evidence of Model Fit for the Pooled Measurement Model of the 
TLGP 

The measurement model for all of the constructs (pooled 
measurement model) involved in the study was then assessed. Using 
this method the correlations between constructs were computed 
simultaneously (Awang, 2014a). Table 6 shows the fit indices of the 
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proposed pooled measurement model. The initial finding shows that 
the chosen fit index tests such as the TLI, CFI, IFI and NFI were still 
less than 0.90 as set by the requirement. However, the values of the 
CMIN/DF and RMSEA achieved the minimum cut-off point. 

Table 6 


The fit indices for the proposed pooled measurement model 


Fit Index 

CMIN/DF 

«=5.0) 

TLI 

0=0.9) 

CFI 

(>=0.9) 

IFI 

(>=0.9) 

NFI 

0=0.9) 

RMSEA 

(<=0.08) 

Value 

2.355 

0.810 

0.820 

0.821 

0.726 

0.069 


The Modification Index (MI) was considered so as to obtain the 
required value. Several items were further deleted to reduce the 
discrepancy value. The items were CI53 and CI54 (38.374); CI46 and 
CI45 (25.309); IC41 and NV64 (20.375); CA29 and NV67 (19.617); 
QL19 and NV60 (18.812); CA31 and CI47 (18.789); IE1 and IC45 
(18.721); CI48 and CI49 (18.177); QL17 and QL19 (17.917); IC37 
and NV59 (16.159). All of the items were deleted because of their 
high MI values. Creating correlations between IE10 and IE11; IE10 
and IE13; IE15 and IE16; CI51 and CI56; CI51 and CI52; and CI50 
and IC44 had increased the required value as is shown in Table 7, 
and the revised pooled measurement model is shown in Figure 1. 

Table 7 

The fit indices for the revised pooled measurement model 


Fit Index 

CMIN/DF 

TLI 

CFI 

IFI 

NFI 

RMSEA 


«=5.0) 

(>=0.9) 

0=0.9) 

0=0.9) 

(>=0.9) 

(<=0.08) 

Value 

2.107 

0.901 

0.913 

0.913 

0.847 

0.063 


The relative Chi-square was at an acceptable value of 2.046 while 
the other fit statistics were more than the cut-off value of 0.90. The 
RMSEA value of 0.060 was much better than the suggested value 
of 0.08. Only the value of the NFI (0.847) was still less than 0.90 
as set by the requirement, but it was still acceptable (Hair et al., 
2010; Holmes-Smith, Cote, & Cunningham, 2006). In conclusion, 
the pooled measurement model of TLGP fit the collected data. 
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Chi-Square=808.985; p value (>.05)=000 
DF=384 

Relative Chi-Sq (<5.0)=2.107 



Figure 1. The revised pooled measurement model of the TLGP 


Evidence of discriminant validity 

Discriminant validity measures the extent to which constructs are 
different. Discriminant validity is present when the correlation 
between each pair of the latent construct is less than 0.90 (Hair et 
al., 2010). It indicates that each construct shared more variance 
with its items than it does with other constructs. Table 8 shows the 
correlation matrix for the constructs where the correlation coefficients 
values between constructs were all less than 0.90. Therefore, the 
discriminant validity of all six constructs in this study was achieved. 
In conclusion, all six constructs in the pooled measurement model 
were deemed significantly different. 
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Table 8 

The Discriminant Validity Index Summary Based on the Correlation 
Coefficient Values 


Construct 

IE 

QL 

CA 

IC 

Cl 

NV 

IE 

1.00 






QL 

0.830 

1.00 





CA 

0.770 

0.820 

1.00 




IC 

0.890 

0.620 

0.730 

1.00 



Cl 

0.790 

0.730 

0.840 

0.840 

1.00 


NV 

0.730 

0.720 

0.850 

0.760 

0.830 

1.00 


All values less than 0.90 are significant at p < 0.01 


Evidence of content validity after several items were deleted 

According to Haynes et al. (1995), content validity is a vital 
component in construct validity. It provides the evidence about 
the degree to which the elements of the assessment instrument are 
relevant to and representative of the targeted construct. The previous 
study had reported the process of content validation for the original 
67 items. For the remaining items in this study, nine experts were 
identified and invited to review the instrument for content validity. 
The Content Validity Index (CVI) was used to indicate the degree 
of agreement among the experts (Lynn, 1986). A favourable rating 
among the experts yielded a CVI of 0.989 or 98.9%, denoting a high 
level of agreement (Lawshe, 1975) as is summarised in Table 9. 

Table 9 

Content Validity Indices (CVI) 


Number of Items 

Number in 
Agreement 

CVI 

Guideline 

6-7, 9-14, 18, 20-21, 28, 32-34, 
36, 38-40, 44, 50-52, 56-58, 61 
and 63 

9/9 

1.00 

Agree on relevance 

15-16 and 58 

8/9 

0.89 

Agree on relevance 



Proportion 

favourable 

Agree on relevance 



(29.67/30) 

Total favorable 



0.989 

100% 
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DISCUSSION 

This study was part of a larger study aimed at developing a framework 
for teaching and learning in a higher education environment. The 
purpose of this study was to further validate the guiding principles 
that were developed from the previous stage of the research. The 
constructs that underlay the principles would form the core elements 
of the framework. Teaching and learning principles could be used 
as a guide to facilitate higher levels of teaching and learning. In 
the context of teacher education institutions, the AERA panel on 
Research and Teacher Education (Cochran-Smith & Zeichner, 2005 
in Korthagen et al., 2006) made the conclusion that there was no clear 
evidence that certain approaches in teacher education might be more 
effective than others. Furthermore, they questioned the effectiveness 
of teacher education on student teachers’ performance. However, 
Brouwer and Korthagen (2005) argued that this conclusion was made 
based on a comparison of the general instructional strategies used in 
a program. In other words, they were compared at a high level of 
abstraction. They claimed that more specific principles guiding the 
practices within a program might lead to clear and desired outcomes 
in the graduates of such a program. Since the development of our 
principles are based on a narrower concept of teaching and learning, 
we believe that our principles are specific enough to guide educators 
and students towards making a significant improvement in how 
teaching and learning are practiced. However, we are well aware 
of the fact that any desired change in the practices of teaching and 
learning is an in-depth process that may take many years to become 
effective. It also requires a corresponding change in thinking about 
educating learners, and the enormous implications for educators, 
which in turn, will involve an attitudinal shift (Korthagen et al., 2006). 


CONCLUSION AND IMPLICATIONS 

In further validating the TLGP, the analysis has yielded six reliable 
and valid factors of the TLGP, namely Intellectual Excitement, 
Quality Learning, Constructive Alignment, International Cultural, 
Inquiry Reflection and Good Values. After undergoing the iterative 
process of validation, a total of 37 items were deleted, and three 
covariances were created as suggested by the modification index. A 
summary of the validation process is as shown in Table 10. 
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Table 10 


Summary of the Validation Process and Number of Items of the 
TLGPI 


Validation Process 

Number 
of Items 

Number 
of Deleted 
Items 

Deleted Items/ Note 

Proposed Model 

67 items 

- 

- 

Unidimensionality 

Test 

62 items 

5 items 

IE8, QL26, CI55, NV65 and 
NV66 

Individual Con¬ 
struct CFA 

48 items 

14 items 

IE2, IE3. IE4, IE5, QL22, 
QL23, QL24, QL25, QL27, 
IC42 IC43, CA35, CA30 and 
NV62 

Pooled Measure¬ 
ment Model CFA 

30 items 

18 items 

CI53, CI54, CI46, IC45, 
IC41, NV64, CA29, NV67, 
QL19, NV60, CA31, CI47, 
IE1, CI48, CI49, QL17, IC37 
and NV59 

Content Validity 

30 items 

- 

0.989 of Content Validity 
Index (CVI) value 


The goodness of fit indices of the CFA indicated a good fit of the 
collected data and the model. Hence, while we have retained all 
six constructs from the previous research, the number of items or 
indicators of the constructs have been reduced to 30. However, we 
have strengthened the psychometric properties of the TLGPI by 
showing the evidence for construct reliability, model goodness of fit, 
convergent validity and discriminant validity. We had hypothesised 
that the TLGPI measured the constructs of the TLGP, thus by 
strengthening the TLGPI, we had correspondingly strengthened the 
measurement model of the TLGP. While the main purpose of the 
research was to validate the model structure of the factors underlying 
the TLGP, we were also able to validate the instrument (i.e., the 
TLGPI) that we used to collect data on aspects that were important 
in guiding teaching and learning in higher learning institutions. We 
therefore, conclude that our TLGP has reliable and valid constructs 
that represent the aspects of teaching and learning that are important 
for Malaysian Higher Learning Institutions. 
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The relevant constructs of teaching and learning can help quantify 
aspects of teaching and learning from the perspective of educators 
in higher learning institutions. And with this validated instrument, 
future research in developing teaching and learning principles will 
benefit from the enhanced psychometric aspect. The present study 
can be extended to different settings and sample in order to achieve 
a better measurement model. Although our number of participants 
exceeded the minimum number required for running the CFA, 
it only constituted 0.90% of the total population. It is hoped that 
by validating the teaching and learning principles, a broader 
spectrum of related issues will be addressed in the future in order to 
better guide teaching and learning practices. 

This study is vital in the context of Malaysian higher learning 
institutions and can potentially be useful in the wider Asian context 
since every institution needs to have a set of principles that can guide 
the teaching and learning practices so as to ensure a high-quality 
learning environment is provided for students. However, it remains 
arguable whether these principles are functional and practical and, 
as such, it is still in need of further research. Specifically, while few 
would argue against the view that educators need to use theoretical 
principles of learning to guide instruction, it is often not easy to 
apply the theoretical principles in actual practice. Thus, further 
research is needed to determine if the model achieves this aim 
through an investigation of perceived usefulness by practitioners, 
researchers, and learners. Nevertheless, the aspirations stated in the 
Malaysia education blueprint for higher education are in line with 
the principles developed in this study. 
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